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(54) IMAGE DATA INTERPOLATION METHOD AND DEVICE AND MEDIUM RECORDING IMAGE 
DATA INTERPOLATION PROGRAM 



(57) Even when a jaggy occurs in an original image, 
the image is accurately enlarged and a good image can- 
not be obtained as a result 

In the case of performing pixel interpolation on an 
image in a dot matrix state, image data is entered in 
step 1 00, the whole image is scanned while shifting a 
marked pixel, and whether or not an edge exists in the 
direction of 45 or 1 35 degrees by using the marked pixel 
as a reference is detected in step 1 1 5. When an edge at 
45 or 135 degrees exists, the edge is smoothed in the 
direction of either 45 degrees in step 120 or 135 
degrees in step 125. After that, pixel interpolation is car- 
ried out irrespective of the presence or absence of an 
edge. Consequently, when there are irregular edges, it 
can be prevented that an image is directly subjected to 
pixel interpolation and a jaggy occurs. 
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Description 

Technical Field 

5 [0001] The present invention relates to an image data interpolating method, an image data interpolating apparatus, 
and a medium on which an image data interpolating program is recorded. 

Background Art 

70 [0002] When an image is dealt by a computer or the like, the image is expressed by pixels In a dot matrix state and 
each pixel is expressed by a gradation value. For example, a photograph or computer graphic is often displayed by pix- 
els of 640 dots in the horizontal direction and 480 dots in the vertical direction on the screen of a computer. 
[0003] On the other hand, the perfomnance of a color printer has been being remarkably improved. The color printer 
has extremely high definition such as dot density of 720 dpi. In the case of printing an image of 640 x 480 dots in a cor- 

75 responding manner on a dot unit basis, the image becomes very small. In this case, since the gradation values are dif- 
ferent and the meaning itself of resolution differs, the image has to be converted to data for printing by interpolating the 
dots. 

[0004] As conventional methods of interpolating dots in such a case, methods such as nearest neighboring inter- 
polation (hereinbeiow, called a nearest method) and cubic convolution interpolation (hereinbelow, called a cubic 
20 rhethod) are known. Japanese Unexamined Patent Application No. 6-225140 discloses a technique of smoothing an 
edge in the event of interpolating dots by preparing a dot pattern by which an image is enlarged in a shape having a 
smooth edge. 

Disclosure of Invention 

25 

[0005] The conventional technique has the following problems. 

[0006] Although an interpolating operation of the cubic method requires an arithmetic process of a high load, an 
image is smooth and is not blun-ed. An image is, however, accurately enlarged even when a jaggy occurs in the original 
image, so that a good image cannot be obtained as a result. 
30 [0007] On the other hand, in the invention disclosed in Japanese Unexamined Patent Application No. 6-225140, 
since a pattern has to be prepared, an interpolation magnification has to be fixed. The invention therefore, cannot cope 
with an arbitrary interpolation magnification. On the precondition of using a color image, the number of pattems is enor- 
mous and it is difficult to even prepare the patterns. 

[0008] The Invention has been achieved in consideration of the above problems and its object is to provide an 
35 image data interpolating method, an image data interpolating apparatus, and a medium on which a printing image data 
interpolation program is recorded, which can suppress a jaggy in an interpolated image even when an original image 
has a jaggy portion. 

[0009] In order to achieve the object, the invention according to claim 1 comprises: an edge direction detecting step 
of detecting an edge included in image data and a continuing direction of the edge; an edge smoothing step of smooth- 
ie ing a portion of the detected edge along the edge continuing direction; and a pixel interpolating step of performing an 
interpolating process after smoothing the edge. 

[0010] In the invention according to claim 1 constructed as described above, in the case of perfomning an interpo- 
lating process of increasing the number of pixels constructing image data, an edge included in image data and the con- 
tinuing direction of the edge are detected in the edge direction detecting step. When the edge and the edge continuing 
45 direction are detected, smoothing is performed along the edge continuing direction In the detected edge portion in the 
edge smoothing step and, after smoothing of the edge, an interpolating process is performed in the pixel interpolating 
step. 

[0011] That is, in the case of performing the pixel interpolation on an image in a dot matrix state, after performing 
the smoothing in the edge continuing direction (called an edge direction), namely, a direction parallel to the edge, the 

50 interpolating process is executed. 

[0012] No jaggy occurs in a portion having no edge. A jaggy occurs in the edge portion in an original image. In this 
case, by preliminarily performing the smoothing operation in the continuing direction of the edge where a jaggy occurs, 
the jaggy is reduced. When the direction of the edge is recognized in the edge portion, therefore, by performing the 
smoothing process in the direction in advance, it can be prevented that a jaggy is caused by the faithful interpolating 

55 process. 

[0013] Although the edge direction is detected in this case, since the smoothing is performed in a predetermined 
direction in order to prevent a jaggy from being enlarged when the pixel interpolation is performed faithfully to the orig- 
inal image, it can be also said as a method of performing the pixel interpolation after smoothing the jaggy portion. In this 
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sense, the invention is not limited to the edge direction but it is sufficient to find the cause of the jaggy and snr^ooth the 
jaggy- The smoothing method can be also changed in accordance with the pattern of a jaggy. 

[0014] Although the image data is obtained in the preceding step, when a target to be processed can be obtained 
in a substantial meaning, various modes can be included. For example, besides the case of obtaining image data from 
5 an external device, also in the case of performing the interpolating process by using image data to which another proc- 
ess has been executed in a certain device, a step of accessing the image data corresponds to the above. Obviously, 
the purpose of interpolating the image data is not limited to adjustment of the resolution of a color printer but also 
adjustment of the resolution of a display. 

[0015] It is sufficient that image data is obtained by expressing an image in multi-shades of gray by pixels in a dot 

10 matrix state. The image data may be in either monotone or color. 

[0016] Although the edge included in the image and the continuing direction of the edge are detected in the edge 
direction detecting step, upon detection of the edge direction, it is difficult to directly determine the edge direction. It is 
easier to set a certain direction as a reference and determine whether or not an edge exists in the direction. 
[0017] As a specific example of the method, the invention according to claim 2 provides an image data interpolating 

75 method according to claim 1 in which in the edge direction detecting step, a facing areas detecting step of dividing an 
area around a predetermined pixel by a straight line oriented at a predetermined angle by using the predetermined pixel 
as a reference into two areas and detecting a status of pixels in each of the areas; and an edge determining step of 
determining the presence or absence of an edge along the straight line on the basis of a difference between the sta- 
tuses of pixels in the detected two areas are executed. 

20 [001 8] In the invention according to claim 2 constructed as mentioned above, for example, a straight line passing a 
certain marked pixel is presumed and the area around the merited pixel is divided into two areas by the straight line. 
Obviously, it is unnecessary to shift the image data into the two areas in practice but the area is divided into two areas 
simply by an imaginary straight line. The area is virtually divided into two areas and the status of pixels in each of the 
areas is detected in the facing areas detecting step. The status of pixels denotes some information indicative of the pix- 

25 els such as brightness or hue. The status is detected by unit such as a totalizing operation or the like. In the edge deter- 
mining step, on the basis of the difference between the detected statuses of the pixels in the two areas, the presence 
or absence of the edge having the predetermined angle is detemiined. 

[0019] The operations are performed as mentioned above because of the following background. When an edge 
exists, the difference between pixels in the areas over the edge is large. In other words, an edge exists when areas hav- 

30 ing a large difference in pixels are neighboring. When the area is divided in the direction which perpendiculariy crosses 
the actually existing edge, a pair of areas sandwiching the inherent edge are included in each of the areas. That is, the 
pixels in the areas sandwiching the edge are averaged, so that a difference between the pixels in the areas is reduced. 
[0020] In the case of detecting the statuses of the pixels by using almost equivalent two areas which face each 
other over the straight line having a predetermined angle as a target, when a difference between the statuses of the 

35 pixels in the two areas is large, it can be said that the straight line coincides with the existing edge. When the difference 
is small, it can: be said that the degree of coincidence between the straight line and the existing edge is. low. The deter- 
mination is can'ied out In the edge determining step. 

[0021] In the facing areas detecting step, the statuses of pixels are detected by using almost equivalent two areas 
which face each other over the virtual edge as a target. The invention Is not limited to a specific method of determining 
40 an area. Needless to say, an area is preferably not away from the edge. In this sense, an area which is. for example, 
adjacent to the virtual edge is desirable. 

[0022] When the status of a plurality of pixels is detected, the processing amount is large. Usually, the number of 
edge pixels is, however, not so large. 

[0023] The invention according to claim 3 provides the image data interpolating method according to claim 1 or 2 
45 in which, in the edge direction detecting step, an edge pixel detecting step of preliminarily determining whether or not 
a marked pixel is an edge or not while shifting the marked pixel for a scan is executed to detect the continuing direction 
of the edge with respect to the pixel detected as an edge pixel. 

[0024] In the invention according to claim 3 constructed as mentioned above, when the edge direction detecting 
step is executed, whether or not a marked pixel is an edge or not is determined while shifting the marked pixel for a 

so scan, and the continuing direction of the edge is detected with respect to the pixel detected as an edge pixel. 

[0025] Specifically, whether the marked pixel is an edge or not is determined first. When it is not an edge, the proc- 
ess of detecting the edge direction of a heavy load is performed as least as possible. The determination of the edge 
pixel in this case can be realized by using various filters. For example, it is sufficient to perform a process of assigning 
predetermined weights to the marked pixel and the neighboring pixels and comparing the resultant pixels. 

55 [0026] In the edge smoothing step, the smoothing is performed along the direction in which the edge is continued. 
The smoothing process is not particulariy limited. As an example, the invention according to claim 4 provides the image 
data interpolating method according to any one of claims 1 to 3 in which, in the edge smoothing step, pixels neighboring 
the marked pixel in the edge continuing direction are synthesized at a predetemiined ratio while shifting the marked 
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pixel. 

[0027] A jaggy occurs in an edge due to a step portion occurring in the edge direction. By preliminarily synthesizing 
the pixels in the neighboring direction at a predetemnined ratio, the step is reduced. For exannple, averaging of the pixels 
etiminates the step. 

5 [0028] That is, in the invention according to claim 4 constructed as mentioned above, by synthesizing the pixels 
neighboring in the edge continuing direction with respect to the marked pixel at a predetermined ratio, the edge is 
smoothed. 

[0029] Although the synthesis is carried out at a predetermined ratio, when the ratio is increased, the degree of 
smoothness becomes higher. When the ratio is reduced, the degree of smoothness becomes lower. By using the rela- 
te tlon, the invention according to claim 5 provides to the image data interpolating method according to any one of claims 
1 to 4, in which In the edge direction detecting step, an edge degree detecting step of detecting the degree of coinci- 
dence with a predetermined edge direction is executed, and in the edge smoothing step, a smoothness degree adjust- 
ing step of increasing the degree of smoothness when the degree of coincidence detected is high and decreasing the 
degree of smoothness when the degree of coincidence is low is performed. 
15 [0030] In the invention according to claim 5 constructed as mentioned above, when the edge direction is detected 
in the edge direction detecting step, the degree of coincidence with the direction in which a predetermined edge con- 
tinues is detected in the edge degree detecting step. In the following edge smoothing step, when the degree of coinci- 
dence detected is high, the degree of smoothness is increased in the smoothness degree adjusting step. When the 
degree of coincidence is low, the degree of smoothness is lowered. 
20 [0031] The degree of coincidence in this case may be either the degree of coincidence in the direction in which the 
edge is continued or the degree of coincidence in the sense of sharpness of the edge. For example, when the degree 
of coincidence with respect to the direction of a predetermined fixed straight line having an angle of 45 degrees or 135 
degrees is relatively low, it can be considered that the edge direction is actually slightly deviated. When the smoothing 
is strongly performed in the direction of the straight line, smoothing to pixels to which smoothing should not be per- 
25 formed is carried out, so that it is not always optimum. When the smoothing is performed by setting the degree of syn- 
thesis to a relatively low value, it is balanced. 

[0032] Various interpolating methods to be performed after smoothing of the edge can be employed. It is usually 
considered that an interpolating process is executed after all of the pixels are smoothed in the edge direction. Holding 
of the image data smoothed in the edge direction with respect to all of the pixels, however, matters from the viewpoint 
30 of storage resources. On the other hand, although an area in a predetermined range is subjected to the interpolating 
process, the interpolating process is basically strongly influenced by neighboring pixels surrounding the pixel to be 
interpolated. It is therefore not always necessary to finish the smoothing operation in the edge direction on all of the pix- 
els in the area. 

[0033] From such a viewpoint, the invention according to claim 6 provides the image data interpolating method 
35 according to any one of claims 1 to 5, in which in the pixel interpolating step, when pixel interpolation is executed on the 
basis of pixels in an area of a predetermined range including a marked pixel in parallel with detection of an edge pixel 
while shifting the marked pixel for a scan, the marked pixel is a pixel on the rear side in the scan direction in the area, 
[0034] In the invention according to claim 6 constructed as described above, while shifting the marked pixel, the 
pixel interpolation is carried out in parallel with the detection of the edge pixel. The pixel interpolation is performed on 
40 the basis of pixels in the area of the predetermined range Including the marked pixel. Even if all of the pixels in the area 
are not finished, the pixel interpolation is executed when a pixel on the rear side in the scan direction in the area 
becomes the marked pixel. 

[0035] The rear side in such a case denotes that the pixel is at least not on the front side. It denotes that the pixel 
interpolation is almost finished. In many cases, all of the pixels in the area do not always have similar degrees of influ- 

45 ence. In this sense, the invention according to claim 7 provides to the image data interpolating method according to 
claim 6, in which in the pixel interpolating step, when the scan direction is divided into a main scan direction and a sub- 
scan direction, the pixel interpolation is executed in the area by using a pixel which is on the rear side in the main scan 
direction and is on the rear side in the sub-scan direction as a marked pixel among four pixels surrounding the area to 
be subjected to pixel interpolation. 

50 [0036] The pixel interpolation Is basically performed on the basis of the four pixels surrounding the area to be inter- 
polated. Consequently, it is sufficient that the smoothing in the edge direction is performed on the four pixels. When the 
scan direction is divided into the main scan direction and the sub-scan direction, at the time point when the pixel which 
is on the rear side in the main scan direction and is on the rear side in the sub-scan direction becomes the marked pixel, 
the smoothing in the edge direction with respect to the four pixels is finished. In the invention according to claim 7 con- 

55 structed as mentioned above, the pixel interpolation is executed at such a time point. 

[0037] When ft is assumed that the main scan direction of certain image data is from left to right and the sub-scan 
direction is from top to down, the rear side in the main scan direction is the right side and the rear side in the sub-scan 
direction is the lower side. It consequently corresponds to the lower right pixel in the upper and lower right and left four 
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pixels. 

[0038] Similarty, when the four pixels surrounding the area to be subjected to pixel interpolation are compared with 
the peripheral pixels, it can be said that the former four pixels surrounding the area to be pixel interpolated directly exert 
a larger influence on the pixel to be interpolated. When the smoothing in the edge direction is performed on the four 
5 pixels, an influence in the result is almost the same. In the pixel interpolating step, therefore, while setting the pixels 
around the four pixels to be a target to be interpolated, the pixel interpolation may be executed on the pixel on the rear 
side in the main scan direction in the innermost four pixels and is on the rear side in the sub-scan direction as a marked 
pixel. 

[0039] That Is, as long as the process is finished on the four pixels which exert a great influence on the result, even 
10 If pixels referred to in the interpolating process remain unprocessed, the pixel interpolation is executed. 

[0040] Although various interpolation methods which can be carried out in the pixel Interpolating step can be 
employed, from the viewpoint of performing a pre-process to suppress a jaggy, an interpolating process which sup- 
presses a jaggy while maintaining sharpness is preferable. 

[0041] The method of performing the pixel interpolation after carrying out the smoothing along the direction in which 
75 edges continue is realized by a substantial apparatus. In this sense, it can be easily understood that the invention can 

be applied as a sulsstantial apparatus. That is, the invention is surely effective as a substantial apparatus. 

[0042] The image data interpolating method may be carried out by itself or together with another method in a state 

where it is installed in a device. The idea of the invention is not limited to the above but includes various modes. It can 

be properly changed to software or hardware. 
20 [0043] When an embodiment of the idea of the invention is software for executing the image data interpolating 

method, it has to be said that the idea of the invention naturally exists on a recording medium on which the software is 

recorded and is used. 

[0044] The recording medium can be, of course, a magnetic recording medium or a magnetooptic recording 
medium. Any recording media which will be developed in future can be similarly considered. The stages of duplication 
25 such as primary duplicate or secondary duplicate are regarded as the same without any doubt. The invention is also 
applied to the case where a communication line is used as a supplying method. 

[0045] Further, the case where a part is realized by software and a part is realized by hardware is also included in 
the idea of the invention. A form in which a part is recorded on a recording medium and the rest is properly read as nec- 
essary may be also used. All of the functions do not always have to be realized by the program but can be realized by 
30 an external program or the like since it is sufficient to make the computer realize each of the functions. 

Brief Description of Drawings 

[0046] 

Fig. •I'-is a rough flowchart of an image data interpolating method according to an embodiment of the invention. 



35 



40 



Fig. 2 is a block diagram of a computer system as an image data interpolating apparatus which practices the image 
data interpolating method. 

Fig. 3 is a schematic block diagram showing another application example of the image data interpolating method 
of the invention. 

Fig. 4 is a schematic block diagram showing another application example of the image data interpolating method 
45 of the invention. 

Fig. 5 is a schematic block diagram showing another application example of the image data interpolating method 
of the invention. 

so Fig. 6 is a schematic block diagram showing another application example of the image data interpolating method 
of the invention. 

Fig. 7 is a flowchart of the image data interpolating method carried out by the computer system. 

55 Fig. 8 is a diagram showing a state in which a marked pixel is shifted in a dot-matrix image. 

Fig. 9 is a diagram showing an arrangement state of a marked pixel and peripheral pixels when an edge pixel is 
determined. 
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Rg. 1 0 is a diagram showing a filter used to determine an edge pixel. 

Rg. 1 1 is a diagram showing another example of a filter used to determine an edge pixel. 
5 Rg. 12 is a diagram showing another example of a fitter used to detemnine an edge pixel. 

Rg. 13 shows a filter for detecting an edge in the direction of 45 degrees. 
Rg. 1 4 shows a filter for detecting an edge in the direction of 1 35 degrees. 

10 

Rg. 15A-15C is an explanatory diagram of a case where an edge detecting filter is applied. 
Rg. 1 6 shows a filter for detecting an edge at another angle. . 
IS Rg. 17 shows an edge detecting filter to which another weighting is applied. 

Rg. 18 is a diagram for explaining smoothing in the edge direction. 

Rg. 19 is a diagram showing an edge portion in an original image in which a jaggy occurs. 

20 

Rg. 20 is a diagram showing an original image in which a jaggy occurs. 

Rg. 21 is a diagram showing a state where smoothing is performed in the edge direction and a jaggy is reduced. 

25 Fig. 22 is a diagram showing an M cubic pixel interpolating method. 

Rg. 23 is a diagram showing a change in an interpolation function used in the M cubic method. 

Rg. 24 is a diagram showing pixels on the inner side which exert a great influence on a pixel to be interpolated and 
30 pixels on the outer side. 

Rg. 25 is a diagram showing a state where the smoothing is completed when pixels on the inner side are finished 
during shifting a marked pixel for scanning. 

35 Best Mode for Canving Out the Invention 

[0047] Embodiments of the invention will be described hereinbelow with reference to the drawings. 
[0048] Rg. 1 Is a flowchart showing a procedure of carrying out an image data interpolating method of the inven- 
tion. Fig. 2 is a block diagram of a computer system 1 0 which executes the image data interpolating method in accord- 
40 ance with the flowchart. 

[0049] The computer system 10 comprises a scanner 11a, a digital still camera lib, and a video camera 1 1c as 
image input devices which are connected to a computer body 12. Each input device creates image data by expressing 
an image by pixels in a dot matrix and can output the image data to the computer body 1 2. The image data can express 
about 1 6,700,000 colors by displaying 256 shades for each of the three primary colors of R, G, and B. 

45 [0050] A floppy disk drive 13a, a hard disk 13b, and a CD-ROM drive 13c as external auxiliary storage devices are 
connected to the computer body 12. On the hard disk 13b, main programs related to the system are recorded and a 
necessary program or the like can be properly read from a floppy disk 1 3a-1 , a CD-ROM 1 3c-1 , and the like. 
[0051] As a communication device for connecting the computer body 12 to an extemal network or the like, a modem 
14a is connected. The computer body 12 is connected to an outside network via a public communication line, so that 

50 software or data can be downloaded. Although the system accesses the outside by the modem 14a via the telephone 
line in the example, it can also access a network through a LAN adapter. A keyboard 15a and a mouse 15b are also 
connected for operating the computer body 12. 

[0052] Further, as image output devices, a display 1 7a and a color printer 1 7b are provided. The display 1 7a has a 
display area of 800 pixels in the horizontal direction and 600 pixels in the vertical direction and can display 16,700,000 
55 colors per pixel as mentioned above. Obviously, the resolution is just an example. It can be properly changed to 640 x 
480 pixels. 1024 x 768 pixels, etc. 

[0053] The color printer 1 7b is an ink jet printer and can print an image by applying dots onto a printing paper sheet 
as a recording medium with color ink of four colors of CMYK. Although high density printing of, for example, 360 x 360 
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dpi or 720 x 720 dpi can be realized, the gradation expression is a two gradation expression of whetlier the color ink is 
applied or not. 

[0054] On the other hand, in order to display or output an image to the image output device while receiving an 
image by using the image input device, predetermined programs are run on the computer body 12. Among them, an 

5 operating system (OS) 12a runs as a basic program. In the operating system 12a, a display driver (DSP DRV) 12b for 
displaying an image on the display 1 7a and a printer driver (PRT DRV) 1 2c for allowing the color printer 1 7b to print and 
output the image are included. The drivers 1 2b and 1 2c and the like depend on the models of the display 1 7a and color 
printer 1 7b and can be added/changed to/in the operating system 12a in accordance with each of the models. Depend- 
ing on the model, an additional function more than the standard process can be also realized. That is, various additional 

10 processes within a permissible range can be realized while maintaining a processing system which Is common on the 
standard system, namely, the operating system 12a. 

[0055] As a matter of course, on the precondition of executing such a program, a CPU 1 2e, a RAM 1 2f. a ROM 1 2g, 
an I/O 12h and the like are provided in the computer body 12. The CPU 12e for executing ah arithmetic process properly 
performs a basic program written on the ROM 12g while using the RAM 12f as a temporary work area, a setup storing 

75 area, or a program area, thereby controlling external devices and internal devices connected via the I/O 12h. 

[0056] An application 12d is executed on the operating system 12a as a basic program. Various processes of the 
application 12d are executed. The operation of the keyboard 15a and mouse 15b as operating devices is monitored. 
When the keyboard 15a or mouse 15b is executed, the application 12d executes corresponding arithmetic processes 
by properly controlling the various external devices and, further, allows the process result to be displayed on the display 

20 1 7a or outputted to the color printer 1 7b. 

[0057] In the computer system 1 0, image data is obtained by the scanner 1 1 a or the like as an image input device 
and a predetermined image process is executed by the application I2d. After that, a resultant image can be displayed 
on the display 17a or outputted to the color printer 17b as image output devices. In this case, when attention is simply 
paid to correspondence between pixels, in the case where the pixel density of the color printer 17b. coincides with that 

25 of the scanner 1 la, the size of an original image scanned coincides with that of an image to be printed. When the pixel 
densities are different from each other, however, the sizes of the images become different Although many scanners 
11a have the pixel density similar to that of the color printer 1 7b, the pixel density of the color printer 17b, which has 
been being improved for higher picture quality is often higher than that of a general image input device. Especially, the 
pixel density of the color printer 17b is much higher than display density of the display 17a. When an image is printed 

30 by making display on the display 1 7a coincide with that on the color printer 1 7b on the pixel unit basis, an extremely 
small image may be resulted. 

[0058] Consequently, while determining the pixel density as a reference in the operating system 12a, resolution is 
converted in order to cancel the difference in the pixel densities of actual devices. For example, when the resolution of 
the display 17a is 72 dpi and 360 dpi is set as a reference in the operating system 12a, the display driver 12b converts 
35 the resolution between them. When the resolution of the color printer 17b is 720 dpi in a similar situation, the printer 
driver 1 2c carries out the resolution conversion. 

[0059] Since the resolution conversion corresponds to a process of increasing the number of pixels constructing 
image data, it corresponds to an interpolating process. Each of the display driver 12b and the printer driver I2c per- 
forms the interpolating process as one of its functions. In this case, each of the display driver 12b and the printer driver 
40 1 2c executes a program corresponding to the flowchart as shown in Fig. 1 to generate an interpolated image while mak- 
ing a jaggy inconspicuous. 

[0060] The flowchart shown in Fig. 1 expresses a rough concept An image data obtaining step A1 of obtaining 
image data processed by a preceding process as an image data to be subjected to an interpolating process, an edge 
direction detecting step of detecting the edge direction of each pixel on the basis of the image data, an edge smooth- 
es ing step A3 for smoothing the edge portion along the edge direction, a pixel interpolating step A4 of executing an inher- 
ent interpolating process after the smoothing operation, and an image data outputting step AS of passing the 
interpolated image data to the next step are sequentially executed. 

[0061 ] Obviously, the display driver 1 2b and the printer driver 1 2c are stored on the hard disk 1 3b and read and run 
by the computer body 12 at the time of start-up. At the time of introduction, they are recorded on a medium such as the 
so CD-ROM 13C-1 orfloppy disk I3a-1 and installed. Each of the media corresponds to a medium on which the image data 
interpolating program is recorded. 

[0062] In the embodiment, the image data interpolating method is carried out by the computer system 1 0. The com- 
puter system is. however, not always necessary. Any system which has to perform an interpolating process on similar 
image data can be used. For example, as shown in Fig. 3, a system in which an image data interpolating device for per- 
55 forming an interpolating process is assembled in a digital still camera 1 1b1 and which allows interpolated image data 
to be displayed on a display 1 7a1 or printed by a color printer 1 7b1 may be also used. As shown in Fig. 4, a color printer 
1 7b2 which receives and prints image data without using the computer system can automatically convert the resolution 
of image data supplied via a scanner 1 1 a2, a digital still camera 1 1 b2, a modem 1 4a2, or the like and print the resultant 
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image data. 

[0063] Moreover, the invention can be naturally applied to various devices for dealing with image data such as a 

color facsimile apparatus 18a as shown in Fig. 5 and a color copying machine 18b as shown in Fig. 6. 

[0064] The flowchart of Fig. 1 shows a procedure of a rough concept. An actual program does not always have to 

5 be clearly divided into the steps. Fig. 7 shows a software flow related to the resolution conversion executed by the 
printer driver 12c. Although the display driver 12b can also similarly execute the program, in the case such that a high 
priority is given to the processing speed, the program is not always necessary to be executed by the display driver 12b. 
[0065] In step 100, image data is entered. According to the application I2d. an image is read by the scanner 11a 
and subjected to a predetenmined image process, Afterthat, the image is subjected to a printing process. Then the print 

10 data with a predetermined resolution is transferred via the operating system 12a to the printer driver 12c. The stage of 
the transfer con-esponds to the image data obtaining step A1 . As a matter of course, a process of reading an image by 
the scanner 1 la is also possible. At any rate, the process corresponds to the image data obtaining step A1 . 
[0066] A whole image is scanned on the basis of the read image data and a pixel interpolating process is executed 
during the scan. That is, not separately performing the edge direction detecting step A2, the edge smoothing step A3, 

15 and the pixel interpolating step A4, but the edge direction of each marked pixel is detected while sequentially shifting 
the marked pixel, the edge is smoothed, and pixels are interpolated. In this sense, the initial position of the marked pixel 
is set in step 105. In step 110 and subsequent steps, as shown in Fig. 8, a sub-operation of sequentially shifting the 
scan line in the vertical direction (height direction) while performing a main scan in the horizontal direction (width direc- 
tion) of an image is executed. 

20 [0067] Before detecting the edge direction, in step 1 10» whether the marked pixel is an edge pixel or not is deter- 
mined. The edge pixel denotes that neighboring pixels are largely different from each other. In order to determine 
whether it is an edge pixel or not, therefore, the marked pixel is compared with a neighboring pixel. When the difference 
between the pixels is large, the marked pixel is determined as an edge pixel. When a pixel in an original image is 
expressed by Y Q, i) by using two-dimensional coordinates although the following description will be given on the pre- 

25 sumption of luminance, each of the RGB elements may be calculated), the difference (d) between the marked pixel Y(j, 
i) and the neighboring right pixel is expressed as follows. 

d = Ya.i+1)-Ya.i) 

30 The difference is obtained with respect to each of the neighboring eight pixels in the periphery. In this case, a filter as 
shown in Fig. 10 is applied. That is, it is expressed as follows. 

d = Y (j , i + 1) - Y 0, i) + Y G + 1 , i + 1 ) - Y 0, i) + Y 0 - 1 , i + 1 ) - Y a, i) + Y (j , i - 1) - Y (i, i) 

+ Y (i + 1 , i - 1) - Y 0 J) + Y a - 1 , i -1 ) - Y G , i) +Y G , i ) - Y (i. i) + Y G + 1 , i ) - Y G, i) + Y G - 1 . i ) - Y a J) 
^ =Y0J + 1) + YG+1J+1) + Y0-1.i + 1)+YG.i-1) + Ya+1.i-1) + Y(j-1,i-1) 

+ Y(j.i) + Ya+1J)+Y(i- 1, i)-8*Y0,i) 

Although the difference (d) is inherently multiplied by 1/8, since (the absolute value of) the difference (d) is compared 

40 with a threshold, it is sufficient to set a relatively large threshold. Consequently, the calculation as mentioned above is 
performed. When the difference from the neighboring pixel is considered as a vector, the direction has to be also taken 
into account. In the example, however, it is assumed that the directions are substantially cancelled out by calculating 
the difference between the marked pixel and each of all the neighboring pixels, so that the direction is ignored. 
[0068] The work of determining whether or not the marked pixel is an edge pixel is not indispensable. As will be 

45 described hereinlater, however, a computation amount to determine the edge direction is large and it is troublesome to 
execute the computation with respect to all of the pixels. The edge pixel determination is consequently perfomned so as 
to reduce the amount of computation. In this case, multiplication is performed once and addition or substraction is per- 
formed nine times. In the case of determining the edge direction, as will be described in detail hereinlater. addition or 
subtraction has to be carried out sixteen times. 

50 [0069] Since the intention is to reduce the computing amount, a filter shown in Fig. 11 or a filter shown in Fig. 12 
may be used. The fitter shown in Fig. 1 1 calculates a difference between the marked pixel and each of only four pixels 
of upper and lower pixels and right and left pixels. The filter shown in Fig. 12 obtains a difference between the marked 
pixel and each of only neighboring two pixels. In each of the cases, it is sufficient to perform multiplication once and exe- 
cute addition or subtraction five or three times. The computing amount can be therefore reduced to 1/2 to 1/3. 

55 [0070] In the case where the marked pixel is determined as an edge pixel, the edge direction is detected in step 
115. For detecting the edge direction, filters shown in Figs. 13 and 14 are used. One of the filters is used to detect an 
edge of 45 degrees (225 degrees) and the other filter is used to detect an edge of 135 degrees (315 degrees). When 
computation is performed by assigning a weight of "1 " and a weight of "-1 " to each of the pixels in an area of 8 x 8 pixels, 
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a difference between an area A and an area B sandwiching a presumed edge is calculated. 

[0071] Since an edge is continuous areas where the difference between pixels is large, the difference of pixels over 
an edge is supposed to be large. When the edge exists in the direction of 45 degrees, it can be said that the difference 
between areas existing on both sides of the edge is large. Referring to the filters in Figs. 13 and 14, a weight of "1" and 
5 a weight of "-1" are assigned so that only two linear areas are to be compared. The difference D between the areas A 
and B is obtained as follows. 

D = ZA - LB 

10 Whether the difference between the two areas Is large or not is determined by comparing the difference with threshold 
thres. When the following relation is satisfied, 

IDI > thres 

15 an edge of 45 degrees or 1 35 degrees exists. A simple example will be described. It is assumed that an image in which 
one side from the edge of 45 degrees as a border is black and the other side is white as shown in Fig. 1 5A exists. When 
a fitter of 45 degrees is applied, as shown in Fig. 158, weight of "1" is assigned to the black pixels area and added, 
weight of "-1 " is assigned to the white pixel area and added, and a difference between them is obtained. Consequently, 
the difference between £A and L B becomes large. In the case of applying a filter of 135 degrees, however, as shown 

20 in Fig. 15C, a pair of a black pixel area and a white pixel area exists in each of both areas sandwiching the edge as a 
border. Z A and r B become equal to each other and the difference is reduced. 

[0072] The angle of an edge is not always limited to 45 degrees or 135 degrees. A filter capable of detecting an 
edge at other degrees can be also employed. Rg. 16 shows an example of a filter used in the case of the other angle. 
Weight of T is assigned to one side from a presumed edge and weight of "-1 " is assigned to the other side. The assign- 

25 ing of weights on a filter can be properly changed. For example, as shown in Fig. 1 6, it is also possible to assign weight 
of "2" to an area of a row parallel to the edge and assign weight of "1" to the other area. Further, although the filter is 
used to detect the edge direction in the foregoing embodiment, other methods can be naturally adopted. 
[0073] In step 115, whether or not there is an edge in the direction of 45 degrees or 135 degrees is determined by 
using the two filters. When an edge is detected, smoothing in the edge direction is performed in step 120 or 125. Fig. 

30 18 shows a smoothing process. 

[0074] The smoothing in the edge direction is performed by a process of matching pixels with those in the edge 
direction by using the marked pixel as a reference. In the case of 45 degrees, it is expressed by the following arithmetic 
equation. 

35 Y a i) = (Y 0 + 1, i - 1) + Y (j - 1. i+ 1)) *wline45 + Y G, i) * (1 - wline45) 

[0075] In the case of 1 35 degrees, it is expressed as follows. 

Y a 0 = (Y G - 1, i - 1) + Y 0 + 1, i + 1)) *wline135.+ Y Q. i) * (1 - wrme135) 

40 

Where wline45 is a coefficient showing characteristics of 45 degrees and wline135 is a coefficient showing characteris- 
tics of 135 degrees, and wrme45 or wline135 is obtained as follows. 

wline (45 or 135) = \ZA - i:BI/2040 

45 

On the presumption of using the filters shown in Figs. 13 and 14, the maximum value of lEA - TB\ is 2040 (= 255*8) in 
the case of 256 gradations (0 to 255). "wline" does not always has to be changeable on the basis of the equation but 
can be a fixed value. It is also possible to make "wline" draw a curve which suddenly largely changes when l£A • £BI 
becomes large. 

so [0076] The method of changing "wline" in accordance with IZA - Z Bl is adapted to a case where the difference 
between the areas divided by the edge direction of 45 degrees is large and a case the difference is small. It is also 
adapted to a case where the difference between the areas divided by the border is constant and there is an edge in a 
direction which is slightly off from the edge direction of 45 degrees. That is. an effect such that the invention can widely 
cope with a slightly deviated edge by adjusting the smoothness while using the filters of 45 degrees and 135 degrees 

55 Is produced. 

[0077] Fig. 19 shows an example of an edge at 45 degrees. In the case of performing the pixel interpolating proc- 
ess, an image having a conspicuous jaggy as shown in Fig. 20 is resulted. When the smoothing is performed along the 
edge direction in advance, however, as shown in Fig. 21 , a jaggy is reduced and smoothed at the stage of the original 
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IS 



20 



25 



image and, after that, the pixel interpolating process is perfomned. Consequently, a jaggy does not easily occur in the 
pixel interpolated image. 

[0078] Each of the images shown in Figs. 1 9 to 21 is displayed by a white area and a black area. Steps each made 
by two pixels are only changed to steps each made by one pixel. It seems that a jaggy might occur when the pixel inter- 
polation is performed to a resultant image. In practice, however, each pixel itself is smoothed in the edge direction and, 
so to speak, a state such that the edge portion becomes gray occurs. When the interpolating process which makes an 
image sharp is performed on the image, therefore, the jaggy does not remain. An effect such that the edge portion 
which has become gray is displayed as a sharp edge is produced. 

[0079] Atthough the smoothing in the edge direction is realized by an extremely simple method in the example, the 
smoothing can be also carried out by using an arithmetic equation of a higher degree. The computing amount of the 
next pixel interpolating process is accordingly large. A sufficient effect can be obtained by the above computing equa- 
tion. 

[0080] Step 130 relates to the pixel interpolating process. In. the embodiment, pixel interpolation of the M cubic 
method which will be described hereinlater is executed. The pixel interpolation is executed irrespective of the detection 
in the edge direction. 

[0081] Before explaining the M cubic method, a general cubic method will be described. In the cubic method, as 
shown in Rg. 22, data of not only four lattice points surrounding a point Puv to be interpolated but also data of total 1 6 
lattice points including lattice points around the four lattice points are used. A general expression using a cubic convo- 
lution function is as follows. 



P=[f(yl)f(y2)f(y3)f(y4)] 


1>U 


P21 


P31 


P4l' 






P12 


P22 


P32 


P42 


f(x2) 




P13 


P23 


psa 


P43 


f(x3) 




,P14 


P24 


PS4 


P44^ 


f(x4). 



30 


f(t) 




t)>/«t 






xl = 


1+(u-IbI) 


yl » 


l+(v-lvl) 


3S 


x2 « 


(u-lul) 


y2 «= 


<v-lvl) 




x8 = 


l-(u- lul) 


y3 = 


l-(v-lvl) 




x4 = 


2-(u-lul) 


y4 = 


2-(v-lvl) 



40 



45 



50 



55 



The above is developed as follows with respect to P. 
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P=tf (ir1> f (y2> f (y3) f (y4) 3 f^P1 1 +P21 • f (x2) +P31 -f (x3) +P41 -f (x4)^ 

PI 2 • f (x1) +P22 • f (x2) +P32 - f (x3) +P42 • f (x4) 
Pt 3 'f (x1) i^P23 • f (x2) •H»33 -f (x3) +P43 • f (x4) 
l^PI 4 - f (x1 ) +P24 • f (x2) +P34 • f (x3) ♦P44 • f (x4) } 



=f(yl) (Pll'f (xD-t-pai.f (x2)-i'P31*f (x3)-^P41-f (x4)} 
« +f (y2) (PI 2 • f (x1) ♦P22 • f (x2) +P32 • f (x3) +P42 • f (x4) ) 

+f (y3) {PI 3 • f (x1 ) +P23 • f (x2) +P33 -f (x3) +P43 -f (x4) J 
+f (y 4) (PI 4 • f (x1 ) +P24 • f (x2) ♦P34 • f (x3) +P44 • f (x4) ) 
=Pn -f (x1) -f (y1)+P21 .f (x2) -f (y1)+P31-f (x3) -f (y1)*P41 -f (x4) -f (y1) 
i'P12.f (x1) -f (y2)+P22.f (x2) -f (y2)+P32-f (x3) -f (y2)+P42.f (x4) -f (y2) 
+P13-f (x1) -f (y3)*P23-f (x2) -f Cy3)+P33 f (x3) -f (y3)*P43'f <x4) -f (y3) 
+P14-f (x1) 'f (y4)*P24-f (x2) -f (y4)+P34-f (x3) -f (y4)+P44-f (x4) -f (y4) 



Substitution can be performed as follows. 



f(t) = {sin(fft)>/;rt 

(l-2|tl*«2+ltl«*3 :0^ltl<l 

4-8ltl+5UI**2-ltl**3 :l^Sltl<2 

0 :2^itl 



45 

[0082] Fig. 23 is a chart showing an interpolation function f(t) in the cubic method. In the chart, the lateral axis 
denotes the position and the vertical axis shows the interpolation function. Lattice points exist at positions where t = 0, 
t = 1 , and t = 2 and interpolation points are at positions from t = 0 to 1 . 

[0083] In the cubic method, the interpolation function decreases gradually in an arcuate curve between neighboring 
so two points (t = 0 to 1) and further decreases outside of the two points (t = 1 to 2). That is. a certain edge portion is 
changed so as to have a large difference between the high and low values without causing a step. A preferable influ- 
ence such that sharpness increases and yet no step occurs is exerted on a photograph. 

[0084] According to the cubic method, expression in a cubic function manner is possible. By acQusting the shape of 
the curve, the quality of the interpolation result can be changed 
55 [0085] As an example of the adjustment, the following will be called an M cubic method. In the embodiment, the 
interpolating process is executed. 

0<t<0.5 f(t) = -(8/7)t"3-(4/7)t**2+1 
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0,5<t<1 f(t) = (1-t)(10/7) 

1<t<1.5 f(t) = (8/7)(M)**3+(4/7)(M)"2-(M) 

5 1.5<t<2f(t)= (3/7)(t-2) 

[0086] Rg. 23 shows an interpolation function in the M cubic method. The cubic functional curve is slightly sharper 
and it denotes that the entire image becomes sharper 

[0087] To perfomi the pixel interpolation by the M cubic method, as mentioned above, the area of 4 x 4 pixels is 
10 used as a target and pixels are interpolated in the area ot 2 x 2 pixels on the inner side. Consequently, rt is preferable 
to finish smoothing in the edge direction with respect to ail of 4 x 4 pixels as a reference of the pixel interpolation by the 
time of interpolation. 

[0088] As shown in Fig. 24, each of pixels generated in the area of the 2 x 2 pixels on the inner side satisfies 0 < t 
< 1 and each of twelve pixels on the outer side satisfies 1 < t < 2. As understood from the interpolation function shown 
15 in Fig. 23, the coefficient used to refer to a pixel on the outer side is naturally small. That is, basically, it is strongly influ- 
enced by the four pixels on the inner side. The twelve pixels on the outer side just exert an influence on the curve of the 
degree of change. In consideration of the states, even if smoothing is not completed with respect to all of the 4x4 pixels 
to be refen-ed to. when at least the pixels on the inner side have been smoothed, it can be said that there is no much 
influence. 

20 [0089] On the contrary, in the case of performing interpolation after smoothing all of pixels referred to, there are det- 
rimental effects such that a marked pixel for smoothing and a marked pixel for generating an interpolation pixel have to 
be separately looped and the smoothness wline has to be stored by an amount corresponding to the interval between 
the two marked pixels. 

[0090] In consideration of the above, in the embodiment, the pixel interpolation of the M cubic method is perfonned 

25 after the four pixels on the inner side which exert a great effect when referred to in the pixel interpolation as shown in 
Fig. 24 are finished. On the precondition that a sub-scan is performed while carrying out a main scan by shifting the 
marked pixel as shown in Rg. 8, the four pixels on the inner side are finished after ten pixels are smoothed as shown in 
Fig. 25, In the case of the Alter of 8x 8 pixels shown in Figs. 13 and 14, at the timing, a hatched pixel becomes a marked 
pixel. To be specific, pixels are scanned as shown in Fig. 8 by using a single pixel as a marked pixel. The filter of 8 x 8 

30 pixels is applied at the 37th pixel after 36 pixels are completed as shown in Figs. 13 and 14. In the target area of 4 x 4 
pixels, it is applied at the eleventh pixel after completion of ten pixels. As a result, while simplifying the control of the 
marked pixel, the pixel interpolation can be performed in a state where.no large error is expected. 
[0091] In the embodiment, the marked pixel is positioned as shown in Fig. 13. 14 or 25 with respect to the scanning 
direction as shown in Fig. 8. It can be properly changed by a control method. 

35 [0092] After executing the M cubic pixel interpolation as described above, in step 1 35, the marked pixel is advanced 
only by one pixel as shown in Fig. 8 and the processes of step 1 1 0 and subsequent steps are repeated until it Is deter- 
mined in step 140 that all of the pixels are processed. If it is detemnined that all of the pixels are processed, the routine 
advances to step 145 where image data which has been subjected to the pixel interpolating process Is outputted to a 
predetermined area. In this case, the printer driver can output the image data as raster data to the color printer 1 7b. In 

40 the case of executing a further image process, the image data is transfenred as data to be processed. 

[0093] As described above, when the pixel interpolation is performed on an image of a dot matrix state, image data 
is entered in step 1 00, the whole image is scanned with respect to the marked pixel. In step 1 1 5, whether or not an edge 
exists in the direction of 45 degrees or in the direction of 135 degrees of the marked pixel as a reference is detected. 
When there is an edge at 45 or 135 degrees, the edge is smoothed in the direction of 46 or 135 degrees in step 120 or 

45 125. After that, the pixel interpolation is performed In-espective of the presence or absence of an edge. It can be con- 
sequently prevented that pixel interpolation Is performed in a state where there is an irregular edge or the like and a 
jaggy occurs. 



so 



Industrial Applicability 



[0094] The invention according to claims 1. 8 and 15 as described above can provide image data interpolating 
methods capable of suppressing occurrence of a jaggy in an interpolated image by performing pixel interpolation after 
eliminating the cause of the jaggy 

[0095] The invention according to claims 2, 9 and 16 can detect the edge direction relatively easily. 
55 [0096] Further, the invention according to claims 3. 10 and 17 can reduce a processing amount since the edge 
direction is not determined with respect to all of pixels but is detemnined with respect to only a pixel which is determined 
as an edge by performing relatively easy edge pixel determination. 

[0097] Further, the invention according to claims 4, 1 1 and 18 can perform smoothing in the edge direction rela- 
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tively easily. 

[0098] Further, the invention according to claims 5, 1 2 and 1 9 can perfonm better smoothing by making the degree 
of smoothing in the edge direction correspond to characteristics of the edge. 

[0099] Further, the invention according to claims 6. 13 and 20 can execute a pixel interpolating process in parallel 
5 without requiring much storage resources. 

[0100] Further, the invention according to claims 7, 14 and 21 can execute both smoothing and pixel interpolation 
in parallel when an area of four pixels surrounding an area to be interpolated. For example, when the smoothing is per- 
formed to the innermost four pixels surrounding the area to be subjected to pixel interpolation and then the interpolating 
process is performed, effects similar to the case where all of the area is smoothed can be obtained. 

to 

Claims 

1 . An image data interpolating method characterized by comprising: 

»5 an edge direction detecting step of detecting an edge included in image data and a continuing direction of the 

edge; 

an edge smoothing step of smoothing a portion of the detected edge along the edge continuing direction; and 
20 a pixel interpolating step of performing an interpolating process after smoothing the edge. 

2. The image data interpolating method according to claim 1 , characterized In that in the edge direction detecting 
step, a facing areas detecting step of dividing an area around a predetermined pixel by a straight line oriented at a 
predetermined angle by using the predetermined pixel as a reference into two areas and detecting a status of pixels 

25 in each of the areas; and an edge determining step of determining the presence or absence of an edge along the 
straight line on the basis of a difference between the statuses of pixels in the detected two areas are executed. 

3. The image data interpolating method according to claim 1 or 2, characterized in that in the edge direction detecting 
step, an edge pixel detecting step of preliminarily determining whether or not a marked pixel is an edge or not while 

30 shifting the marked pixel for scanning is executed to detect the continuing direction of the edge with respect to the 
pixel detected as an edge pixel. 

4- The image data interpolating method according to any one of claims 1 to 3, characterized in that in the edge 
smoothing step, pixels neighboring the marked pixel in the edge continuing direction are synthesized at a predeter- 
35 mined ratio while shifting the marked pixel. 

5. The image data Interpolating method according to any one of claims 1 to 4, characterized in that in the edge direc- 
tion detecting step, an edge degree detecting step of detecting the degree of coincidence with a predate mil ned 
edge direction is executed, and in the edge smoothing step, a smoothness degree adjusting step of increasing the 

40 degree of smoothness when the degree of coincidence detected is high and decreasing the degree of smoothness 
when the degree of coincidence is low is executed. 

6. The image data interpolating method according to any one of claims 1 to 5, characterized in that in the pixel inter- 
polating step, when pixel interpolation is executed on the basis of pixels in an area of a predetermined range includ- 
es ing a marked pixel in parallel with detection of an edge pixel while shifting the marked pixel, the pixel interpolation 

is executed so that the marked pixel is a pixel on the rear side In the scan direction in the area. 

7. The image data interpolating method according to claim 6, characterized in that in the pixel interpolating step, when 
the scan direction is divided into a main scan direction and a sub-scan direction, the pixel interpolation is executed 

so in the area by using a pixel which is on the rear side in the main scan direction and on the rear side in the sub-scan 
direction as a marked pixel among four pixels surrounding the area to be subjected to pixel interpolation. 

8. An image data interpolating apparatus characterized by comprising: 

55 edge direction detecting unit for detecting an edge included in image data and a continuing direction of the 

edge; 

edge smoothing unit for smoothing a portion of the detected edge along the edge continuing direction; and 
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pixel interpolating unit for performing an interpolating process after smoothing the edge. 



9. The image data interpolating apparatus according to claim 8, characterized in that the edge direction detecting unit 
executes: lacing areas detecting unit of dividing an area around a predetermined pixel by a straight line oriented at 

5 a predetermined angle into two areas by using the predetemilned pixel as a reference and detecting a status of pix- 

els in each of the areas; and edge determining unit of determining the presence or absence of an edge along the 
straight line on the basis of a difference between the statuses of pixels in the detected two areas. 

10. The image data interpolating apparatus according to daim 8 or 9, characterized in that the edge direction detecting 
10 unit comprises edge pixel detecting unit of preliminarily determining whether a marked pixel is an edge or not while 

shifting the marl<ed pixel for a scan, and detects the edge continuing direction with respect to a pixel detected as 
an edge pixel by the edge pixel detecting unit. 

11. The image data interpolating apparatus according to any one of claims 8 to 10, characterized in that the edge 
75 smoothing unit synthesizes pixels neighboring in the edge continuing direction with respect to a marked pixel at a 

predetermined ratio while shifting the marked pixel for a scan. 

12. The image data interpolating apparatus according to any one of claims 8 to 1 1 , characterized in that the edge direc- 
tion detecting unit comprises edge degree detecting unit of detecting the degree of coincidence with a predeter- 

20 mined edge direction, and the edge smoothing unit comprises smoothness degree adjusting unit of increasing the 

degree of smoothness when the degree of coincidence detected by the edge degree detecting unit is high and 
decreasing the degree of smoothness when the degree of coincidence is low. 

13. The image data interpolating apparatus according to any one of claims 8 to 12. characterized in that when pixel 
25 interpolation is executed on the basis of pixels in an area of a predetermined range including a marked pixel in par- 
allel with detection of an edge pixel while shifting the marked pixel for a scan, the pixel interpolating unit executes 
the pixel interpolation so that the marked pixel is a pixel on the rear side in the scan direction in the area. 

14. The image data interpolating apparatus according to claim 13, characterized in that when the scan direction is 
30 divided into a main scan direction and a sub-scan direction, the pixel interpolating unit executes the pixel interpo- 
lation in the area by using a pixel which is on the rear side in the main scan direction and is on the rear side in the 
sub-scan direction among four pixels surrounding the area to be subjected to pixel interpolation. 

15. A medium on which an image data interpolating program for realizing a function of performing pixel interpolation on 
35 image data by a computer is recorded, characterized in that the computer is allowed to execute: 

an edge direction detecting function of detecting an edge included in the image data and a continuing direction 
of the edge; 

40 an edge smoothing function of smoothing a portion of the detected edge along the edge continuing direction; 

and 

a pixel interpolating function of performing an interpolating process after smoothing the edge. 

45 16. The medium on which the image data interpolating program is recorded according to claim 15, characterized in that 
in the edge direction detecting function, a facing areas detecting function of dividing an area around a predeter- 
mined pixel by a straight line oriented at a predetermined angle by using the predetermined pixel as a reference 
into two areas and detecting a status of pixels in each of the areas; and an edge determining function of detenmin- 
ing the presence or absence of an edge along the straight line on the basis of a difference between statuses of pix- 

50 els in the detected two areas are executed. 

17. The medium on which the image data interpolating program is recorded according to claim 15 or 16, characterized 
in that the edge direction detecting function executes an edge pixel detecting function of preliminarily determining 
whether a marked pixel is an edge or not while shifting the marked pixel for a scan, and detects the edge continuing 

55 direction with respect to the pixel detected as an edge pixel. 

18. The medium on which the image data interpolating program is recorded according to any one of claims 15 to 17, 
characterized in that the edge smoothing function synthesizes pixels neighboring in the edge continuing direction 
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with respect to a marked pixel at a predetermined ratio while shrftingLthe marked pixel for a scan. 



19. The medium on which the image data interpolating program is recorded according to any one of claims 15 to 1 8, 
characterized in that in the edge direction detecting function, an edge degree detecting function of detecting the 

5 degree of coincidence with a predetermined edge direction is executed and, in the edge smoothing function, a 

smoothness degree adjusting function of increasing the degree of smoothness when the degree of coincidence 
detected is high and decreasing the degree of smoothness when the degree of coincidence is low is executed. 

20. The medium on which the image data interpolating program is recorded according to any one of claims 15 to 19, 
10 characterized in that when pixel interpolation is executed on the basis of pixels in an area of a predetermined range 

including a marked pixel in parallel with detection of an edge pixel while shifting the marked pixel for a scan, the 
pixel interpolating function executes the pixel interpolation so that the marked pixel is a pixel on the rear side in the 
scan direction in the area. 

15 21 . The medium on which the image data interpolating program is recorded according to claim 20, characterized in that 
when the scan direction is divided into a main scan direction and a sub-scan direction, the pixel interpolating func- 
tion executes the pixel interpolation in the area by using a pixel which is on the rear side in the main scan direction 
and is on the rear side in the sub-scan direction as a marked pixel among four pixels surrounding the arBa to be 
subjected to pixel interpolation. 
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